Apply deep learning to improve the question analysis model in the Vietnamese question answering system
نویسندگان
چکیده
Question answering (QA) system nowadays is quite popular for automated purposes, the meaning analysis of question plays an important role, directly affecting accuracy system. In this article, we propose improvement question-answering models by adding more specific steps, including contextual characteristic analysis, pos-tag and question-type built on deep learning network architecture. Weights extracted words through steps are combined with best matching 25 (BM25) algorithm to find relevant paragraph text incorporated into QA model least noisy answer. The dataset step consists 19,339 labeled questions covering a variety topics. Results train data set related regulations Industrial University Ho Chi Minh City. It includes 17,405 pairs answers training 1,600 test set, where robustly optimized BERT pre-training approach (RoBERTa) has F1-score 74%. improved significantly. For long complex questions, mode weights correctly provided based question’s contents.
منابع مشابه
Investigating Embedded Question Reuse in Question Answering
The investigation presented in this paper is a novel method in question answering (QA) that enables a QA system to gain performance through reuse of information in the answer to one question to answer another related question. Our analysis shows that a pair of question in a general open domain QA can have embedding relation through their mentions of noun phrase expressions. We present methods f...
متن کاملA Factoid Question Answering System for Vietnamese
In this paper, we describe the development of an end-to-end factoid question answering system for the Vietnamese language. This system combines both statistical models and ontology-based methods in a chain of processing modules to provide high-quality mappings from natural language text to entities. We present the challenges in the development of such an intelligent user interface for an isolat...
متن کاملA Model of Vietnamese Person Named Entity Question Answering System
In this paper, we proposed a Vietnamese named entity question answering (QA) model. This model applies an analytical question method using CRF machine learning algorithm combined with two automatic answering strategies: indexed sentences database-based and Google search engine-based. We gathered a Vietnamese question dataset containing about 2000 popular “Who, Whom, Whose” questions to evaluate...
متن کاملLearning Paraphrases to Improve a Question-Answering System
In this paper, we present a nearly unsupervised learning methodology for automatically extracting paraphrases from the Web. Starting with one single linguistic expression of a semantic relationship, our learning algorithm repeatedly samples the Web, in order to build a corpus of potential new examples of the same relationship. Sampling steps alternate with validation steps, during which implaus...
متن کاملVisual Question Answering using Deep Learning
Multimodal learning between images and language has gained attention of researchers over the past few years. Using recent deep learning techniques, specifically end-to-end trainable artificial neural networks, performance in tasks like automatic image captioning, bidirectional sentence and image retrieval have been significantly improved. Recently, as a further exploration of present artificial...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Power Electronics and Drive Systems
سال: 2023
ISSN: ['2722-2578', '2722-256X']
DOI: https://doi.org/10.11591/ijece.v13i3.pp3311-3321